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Minimax Impulse Control Problems 
in Finite Horizon 



Brahim EL ASRI 



Abstract 



We consider the problem of impulse control minimax in finite horizon, when 
cost functions (C(t,x,^) > 0). We show existence of value function of the problem. 
[ Moreover, the value function is characterized as the unique viscosity solution of an 

' Isaacs quasi-variational inequality. This problem is in relation with an application 

(-H ■ in mathematical finance. 
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1 Introduction 



> 
p 

^ ' In this paper we study an optimal impulse control problem with finite horizon. 
^ I Optimal impulse control problems appear in many practical situations. In the game, 

player-^ would like to minimize the pay-off by choosing suitable impulse control ^(.), 
^ [ whereas player-r wants to maximize the pay-off by choosing a proper control. In mathe- 
■ matical finance, one may consider the option pricing problem of references [H H]. If the 
piecewise linear transaction costs are replaced by a more realistic piecewise affine cost, 
i.e. a fixed cost is charged for any transaction in addition to a variable part, then the 
problem at hand is exactly that considered here. We refer the reader to p] (and the 
references cited therein) for extensive discussions. For deterministic autonomous systems 
with infinite horizon, optimal impulse control problems were studied in [Ij, and optimal 
control problems with continuous, switching, and impulse controls were studied by the 
author [20] (see also [21]). Differential games with switching strategies in finite and infi- 
nite duration were also studied [221 [23]. J- Yong, in [24], also studies differential games 
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where one person uses an impulse control and other uses continuous controls. 

The study of optimal control problems with continuous controls, gives rise to Hamilton- 
Jacobi-Bellman equations which are satisfied by the value function corresponding to the 
problem, if it is smooth. It is known that the value function of these problems, whenever 
smooth satisfy different variational and quasivariational inequalities. But most of the 
time these value functions are only continuous and not sufficiently smooth. The notion of 
viscosity solutions, a kind of generalized solutions, introduced by Crandall and Lions [7] 
is extremely well suited for these problems. The value function satisfies the correspond- 
ing equations or inequalities in the viscosity sense. These control problems are studied 
in the viscosity solution set up, for example, in [H [6]. In all these works the existence 
and uniqueness results are obtained assuming that the dynamics and cost functionals 
are bounded and uniformly continuous and hence the value functions are in the bounded 
uniformly continuous function class. 

In the finite horizon framework El Farouq et al [13] extended the work of Yong [21] 
but allowing general jumps. In this works the existence of the value functions of optimal 
impulse control problem and uniqueness of viscosity solution are obtained assuming that 
the dynamics and costs functionals are bounded and the impulse cost function should not 
depend on x. Recently El Asri [IT] have considered this impulse control problem when 
the dynamics unbounded and costs functionals are bounded from below and the impulse 
cost function depends on x. 

The purpose of this work is to fill in this gap by providing a solution to the optimal 
impulse control problem using dynamic programming principle tools and partial differen- 
tial equation approach. 

We prove existence of the value function of the problem when costs functionals C > 0. 
We show that the value function of the problem is associated of deterministic functions v 
which is the unique solution of the following system of PDIs (Isaacs equation): 



where K, compact. It turns out that this Isaacs equation is the deterministic version of 
optimal impulse control problem in finite horizon. 
This paper is organized as follows: 



(1.1) 



max 




2 



In Section 2, we formulate the problem, we give the related definitions and we prove 
the value function is bounded from below with linear growth. In Section 3, we give some 
properties of the value function, especially the dynamic programming principle. Then we 
introduce the approximating scheme which enables us to construct a solution for value 
function of the optimal impulse control problem which, in combination with the dynamic 
programming principle, play a crucial role in the proof of the existence of the value 
function. Section 4 is devoted to the connection between the optimal impulse control 
problem and quasi- variational inequality. In Section 5, we show that the solution of QVIs 
is unique in the subclass of bounded from below continuous functions which satisfy a 
linear growth condition. □ 

2 Formulation of the problem and preliminary re- 
sults 

2.1 Setting of the problem 

Let a two-players differential game system be defined by the solution of following dynam- 
ical equations 

r y{t) = fit,y{t),T{t)) 
(2.1) <^ y{to)^xeR^, 

where y{t) is the state of the system, with values in iR™, at time t, x is the initial state. 
The time variable t belongs to [to, T] where < to < ^) and y{t]^) = lim y{t). We assume 

that y is left continuous at the times tk- y{t^) — vitk), k > 1. 

The system is driven by two controls, a continuous control T{t) e JC e IR^, where /C is 
compact set, and an impulsive control defined by a double sequence ti, ...,tk, ■■■,^k, 
k e IN* — W\{0}, where are the strategy, tk < tk+i and £ -K"* the control at time 
tk of the jumps in y{tk). Let <S := ((tfe)fc>i, {£,k)k>i) the set of these strategies denoted by 
V. 

For any initial condition {tQ,x), controls r(-) and S generate a trajectory y(-) of this 
system. The pay-off is given by the following: 



(2.2) J{to,x,S,T{.))= j ij{s,y{s),T{s))ds + Y,C{tk,y{tk),ik)Mt,<T] + G{y{T)), 

•^*o k>l 



where if tk = T for some k then we take G{y(T)) = G{y{T^)). The term C(tk,y(tk),Ck) 
is called the impulse cost. It is the cost when player-^ makes an impulse at time t^. In 
the game, player-^ would like to minimize the pay-off fl2.2p by choosing suitable impulse 
control ^(.), whereas player-r wants to maximize the pay-off (12. 2p by choosing a proper 
control 

r(.) eQ = {measurable functions [to,T] — )• K,}. 
We shall sometimes write r G instead of r(.) G Q. 

We now define the admissible strategies Lp for the minimizing impulse control V, as non- 
anticipative strategies. We shall let Va be the set of all such non-anticipative strategies. 

Definition 1 A map : Q ^ S is called a non-anticipative strategy if for any two 
controls Ti{.) and T2{.), and any t G [to)^^]? the condition on their restrictions to [tQ,t[: 
ri\[to,ti = r2\[to,t[ implies ip{Ti)\\t^^t] = f{r2)\[to,t]- 

In the next, we define the value function of the problem v : [0, T] x JR™ — )■ iR as 

v{to,x)= inf sup J{to,x,ip{r{.)),T{.)) 
v'S^o r(.)en 

2.2 Assumptions 

Throughout this paper T (resp. m) is a fixed real (resp. integer) positive constant. Let 
us now consider the foUowings: 

(1) f : [0,T] X IR"" X IC ^ M"" and g : [0, T] x iR™ x iR™ M"" are two continuous 
functions for which there exists a constant C > such that for any t G [0, T], r G /C and 
^, X, x' G iR™ 

\fit,x,T)\ + \g{t,x,0\<Cil + \x\) and 
^ ^ \9{t, X, - 9{t, x\ 1 + X, r) - fit, x', t) \ < C\x - x'\ 

(2) C : [0, T] X IR^ X JR"^ — )■ iR, is continuous with respect to t and ^ uniformly in x. 
For any e [0,T] x iR™ x iR"^, C(t,x,0 are satisfying 

(2.4) C{t,x,O>0. 
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(3) ip : [0, T] X JR™ X /C — JR is continuous with respect to t and r uniformly in x 
with hnear growth, 



(2.5) 



\i){t,x,T)\ < C(l + V(t,x,T) G [0,T] xM^xK 



and is bounded from below. 



(4) G : iR™ — )■ iR is uniformly continuous with linear growth 



(2.6) 



\G{x)\ < C{l + \x\), Wx e M 



im 



and is bounded from below. 

These properties of / and g imply in particular that ?/(t)o<t<T solution of the standard 
DE (12. ip exists and is unique, for any t G [0, T] and x G iR™. 

2.3 Preliminary results 

We want to investigate the problem of minimizing sup J through the impulse control. We 



mean to allow closed loop strategies for the minimizing control. We remark that, being 
only interested in the inf sup problem, and not a possible saddle point. 

Theorem 1 Under the standing assumptions (Sect. 2.2) the value function v is bounded 
from below with linear growth. 



Proof: Consider the particular strategy in is the one where we have no impulse time. 
In this case X]fc>i ^'(4, ?/(4), 6)l[tfe<T] = 0. 



Now by using standard estimates from ODE, Gronwall's Lemma and the strategy where 
we have no impulse time, we can show that 



v{t, x) < sup[ / ^{s, y{s),r{s))ds + G{y{T))]. 




y{t)\<C{l + \x\), 



where C is constant of T. Hence using this estimate we get 
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v{t,x) < C(l + \x\). 



On the other hand, since the cost C{tk,y{tk),^k) are non negative functions and since "0 
and G are bounded from below, then v is bounded from below. □ 

We also state the following definition: 
Definition 2 For any function v : [tQ,T] x IR"^ — )■ M, let the operator N be given by 



3 The value function 

3.1 Dynamic programming principle 

The dynamic programming principle is a well-known property in optimal impulse control. 
In our optimal control problem, it is formulated as follows: 

Theorem 2 (IT^. Proposition 3.1) The value function v{., .) satisfies the following opti- 
mality principle: 



N[v]{t,x) = mi[v{t,x + g{t,x,0) + C{t,x,0]- 



for all t<t'e [to, T[ and x G iR™, 



V 



= inf sup[ / ij{s,y{s),T{s))ds+ V C{tk,y{tk),^k)'^[tk<T] + '^it'<T]v{t' ,y{t'))], 




and 



V 



{t,x)= inf sup[ / ij{s,y{s),T{s))ds+ Y] C{tk,y{tk),Ql[t^<T] + '^[t„<T]v{tn,y{tn))], 




where {{tn) 



n>l, 



(^n)n>i) be an admissible control. 



Proposition 1 The value function v(.,.) has the following property: 
for all t G [to, T] and x G iR™, 



v(t,x) < N[v]{t,x). 



Proof : Assume first that for some x and t: 



v{t,x) > N[v]{t,x). 
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Then we have for t < t': 
supf / 



rt' 

infsup[/ ^{s,y{s),T{s))ds+ V C{tk,y{tk),ik)^[tk<T] + \'<T]v{t' ,y{t'))] 
> mijvit, X + g{t, x,0) + C{t, x, 0] ■ 

Among the admissible strategy (p'^^s there are those that place a jump at time t. 

rt' 

sup[/ ij{s,y{s),T{s))ds+ C{tk,y{tk),Ck)Ti-[tk<T] + ^'<T]v{t',y{t'))] 

k>i,t,<t' 

> v{t, x + g{t, x, ^)) + C{t, x, ^) - e. 
Now, pick Ti such that 

/ i^{s,y{s),n{s))ds+ J2 C{tk,y{tk),Ck)Ti-[t,<T] + Ti-it'<T]'>^{t',y{t')) + e 

k>\,tk<t' 

rt' 

>sup[/ il){s,y{s),T{s))ds+ ^ C{tk,y{tk),ik)'^[tk<T] + Mt'<T]v{t',y{t'))], 

■^e^ -It f. 



which implies that: 
rt' 

/ iP{s,y{s),Ti{s))ds+ J2 C{tk,y{tk),ik)Mt,<T] + Mt'<T]v{t',y{t')) + e 

k>l,tk<t' 

> v{t, X + g{t, X, 0) + C{t, X, - e. 
Choosing now t' — t, yields the relation 

e + v{t, X + git, x, 0) > v(t, x + g{t, x, ^)) + C(t, x, ^) - e. 
By sending e — >■ 0, we obtain C(t, x, ^) < 0, which is a contradiction. □ 

3.2 Continuity of value function 

In this section we prove the continuity of the value function. The main result of this 
section can be stated as follows. 

We first present some preliminary results on y{.). Consider (p and (t(.), (^(t(.)), 
composed of jumps instants ti, t2, ■■■,tn in the interval [t, T], with jumps ^i, ^2, ■■■,^n, and 
let yi{.) and y2{-) be the trajectories generated by Da, from yi{t) = Xi, i = 1, 2. 



Lemma 1 There exists a constant C such that for any s e \t-iT], xi,X2 G M"^, and 
k e {l,2...,n} 

(3.1) \y,{s) - y2{s)\ < exp(C(s - t)){l + C)^\x, - X2\.a 
Proof : By the Lipschitz continuity of / and Gronwall's Lemma, we have 

\yi{s) - y2{s)\ <eMC{s-t)){l + C)\xi-X2\, Vs e [t,ti]. 
Next let us show for an impulse time 

\yiitt) - y2itt)\ < exp{C{tk - t)){l + C)'\x, - X2\. 
Looking more carefully at the first jump and using the Lipschitz continuity of g, we have 

\yi{tt) - y2{tt)\ = \yi{tl) + git^ ,yiit^),^i) - y2{tT) - 9{tT,y2{tT),^i)\ 

(3.2) <(i + c)i2/i(tr)-?/2(tr)l 

<exp{C{ti-t)){l + C)\xi-X2\. 
The above assertion is obviously true for k — 1. Suppose now it holds true at step k. 
Then, at step k + 1, 

\yi{tU) - y2{tt+i)\ < (1 + C)\y,{t^^,) - 2/2(t,-+i)| 

(3.3) < (1 + C)\y,itt) - y2{tt)\expiCit-,^, - t+)) 

< exp(C(tfe+i - t))(l + C)'^+i|xi -X2\. 

Finally 

|yi(s)-y2(s)| <exp(C(s-t))(l + C)''|xi-X2|, Vse [0,r].n 

We are now ready to give the main Theorem of this article. The value function of the 
problem in which the controller chooses n impulse time is defined as 

(3.4) g"(io,x)= inf sup [ / i;{s,y{s),r{s))ds+TC{tk:y{tk):^k)Ti-[t,<T] + G{y{T))]. 
We will denote the value of making no impulse by g*^, which we define as 

(3.5) q\to,x) = sup [ ri^is,yis),T{s))ds + GiyiT))]. 

r(.)en Jto 

Now, consider the following sequential optimal stopping problems: 
for all t<t' e [to, T] and x e R"", 

(3.6) u;"(t,x)= inf sup[/ ilj{s,y{s),T{s))ds + C{t' ,y{t'),^t,)^t'<T] + w^-\t' ,y{t% 

(t',€t/) red Jt 

where w'^{t, x) — g°(t, x). 
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Proposition 2 (i) The sequence (w")„>o converges decreasingly . 

(ii) For nelN, we have that q'^it, x) = w'^it, x), for all {t, x) E [to, T] x IW^. 

(in) For all {t,x) e [^0,^"] x JR"^, the decreasing sequence {q"'{t,x))n>o converges: 

lim x) = v{t, x). 

Proof : (i) We show by induction on > 0, that for each {t, x) e [to, T] x 

I a; I) > w''{t,x) > w''+\t,x). 

For n — the property is obviously true, since it is enough to take = T in the definition 
of to obtain that > w^. On the other hand taking into account that ip and G are 
hnear growth, then 

w\t,x) < C(l+ I X I). 
Suppose now that, for some n, we have 

w''{t,x) > w''+^{t,x). 

Replace w'^'^^ by in the definition of w'^'^^, to obtain that w'^~^^{t,x) > w'^~^^{t,x). 
On the other hand, since the cost C{tk,y{tk),$,k) a-re non negative functions and since -0 
and G are bounded from below, then by induction on n > 0, is bounded from below, 
(ii) Assume first that for some {t, x) e [0, T] x M"" 

i-T n 

w^{t,x)>q^{t,x)^ inf sup[/ ^{s,y{s),T{s))ds+y^C{tk,y{tk),ik)'^yt,<T\+G{y{T))], 

and let the difference be 2e. Choose an admissible strategy '0'^ that approximates the 
infimum in the r.h.s. up the e. Then, 



u;"(t,x)-e> sup [/ ij{s,y{s),T{s))ds + G{y{T))] + Y.^i^k,y{tk),ik)Mt,<T]. 
Since for any {t, x, e [0, T] x iR'" x iR™, C{t, x,C)>0 then we have: 



w''{t,x) - e > w^{t,x), 

a contradiction with to" is non increasing. 
Assume the contrary that 



^inf sup[ / V'(s,y(s),r(s))ds+C(^^y(^0,6')l[t'<T]+«^"-'(^^y(^')] =^"(^,2;) <g"(i,a:), 

At') T&l Jt 



and let the difference be 2e. Choose a that approximates w"'{t,x) up the ^. Then, 

sup[ / i;{s, y{s),T{s))ds + 6jl[t,<T] + 2/(^1)] - - < x) - 2e. 

Now choose a (^2,^2) that approximates up the ^. Then we have: 

snp[ [ \{s,y{s),T{s))ds + C{t2,y{t2),^t,)^,<T] + w''-\t2,y{t2)] - - < w^-\h^ 
Ten Jh IT' 

It imphes that 

/•ti rt2 

sup[ / 'i/'(-s,y(s),r(s))rfs + C(ti,?/(ti),^tJl[t,<T] + / ^(s,y(s),r(s))rfs 

+C(t2, 2/(^2), 6jl[t.<r] + «^"-'(t2,?/(t2))] - ff < -2e. 

Then 

SUp[ / ^{S, y{s), T{s))ds + C{tl,y{tl),^t^)^i-[t^<T] + C(t2, 2/(^2), 62)l[t2<T] 
tSQ Jt 

+«;"-2(t2,y(t2))]-f <g"(t,x)-2e. 

Repeating this procedure n times, we obtain 

sup [ r^{s,y{s),T{s))ds + f2C{tk,y{h),Ckn[t,<T] + G{y{T))] --< q-{t,x)-2e. 
T(.)Gn A ^ n 

But placing the infimum in the l.h.s. of the last inequality leads to a contradiction. 



(iii) Since ((/"(t, x))„>o is a non- increasing sequence, then 

(3.7) lim(g"(t,x))„>o >t;(t,x), {t,x) E [to,T] x R^. 

Now we show that lim < v{t,x), {t,x) G [to, 7"] x FT". 

Recall the characterization of (12.21) that reads as: 

rT 

v{t,x) = inf sup[/ ^{s,y{s),T{s))ds + y2C{tk,y{tk),Ck)^,<T] + G{y{T))]. 



fc>i 



Fix an arbitrary e > 0. Let tp = ((t„)„>i, {^n)n>i) belongs to Da such that 

v{t,x) + e> sup [ / i{j{s,y{s),T{s))ds + J2C{tk,y{tk),Ck)^t,<T] + G{y{T))]. 
T(.)en Jt 



r{.)en Jt 

Since for any {t, x, e [0, T] x M"^ x JR"", C{t, x, > then we have: 

r{.)£n Jt ^^-^ 

10 



!{t,x) + e> sup [ / V'(s,2/(s),r(s))rfs + ^C(4,y(4),efc)l[t,<T] + G'(y(T))]. 
T(.)&n Jt 



Then 

v{t,x)+e> inf sup[/ ij{s,y{s),T{s))ds+y2C{tk.y{tk),^k)^,<T]+G{y{T))] ^ q'^it.x), 
And then 

v{t,x) + €> hm x). 

n—^oo 

As e is arbitrary then putting e ^ to obtain: 

(3.8) v{t,x) > hm q''{t,x).a 

n—^oo 

Theorem 3 The value function v : [0, T] x JR^ M is continuous in t and x. 

Proof. The proof is divided in three steps. Let us consider e > and (t' , x') G B{{t, x), e) 
Step 1. First let us show that is upper semi- continuous. RecaU the characterization 
of that reads as 

g"(t,a;)= inf sup[ / ^lj{s,y{s),T{s))ds + Y,C{tk,y{tk),^k)Mt,<T]+G{y{T))], 

q^{t',x') = inf sup[/ i;{s,y\s),r{s))ds + y2C{tk:y'{h),^k)Ti-[t,<T] + G{y{T))]. 

v^^Da ren Jt' 

Fix an arbitrary > 0. Let = {{tn)n>i, {^n)n>i) belongs to Da such that 

sup[ / ^(5, y{s),T{s))ds + C{tk: y{tk) , ^k)^t,<T] + G{y{T))] 

k=i 

J- n 



ref2 Jt 



< inf sup[/ i;{s,y{s),r{s))ds + y2C{tk,y{tk),^k)Mt,<T] + G{y{T))] + e^ 
veDa ren Jt ^ 



Also, 



q^{t',x')<sup[ i;{s,y\s),T{s))lis>tqds + TC{tk,y\tk),^k)^t,<T] + G{y{T))]. 
ren Jt' 

Now pick Ti such that 



sup[ I ijis,y\s),T{s))l[s>t']ds + 5]C(4,y'(tfc),6)l[t,<T] + G{y{T))] 

k=l 

n 

^(s,y'(s),Ti(s))l[,>t.]ds + J]C'(tfe,|/'(tfe),efe)l[t,<T] + G(y(r)) + e\ 



Ten Jt' 
< 



k=l 
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Then 



< / ijis,y\s),T\s))l[s^t']ds + y2C{tk,y\t,),Ck)^t,<T] 

k=i 

+G{y{T))- [ ij{s,y{s),T\s))ds 



J2C{h,y{h),^k)l[t,<T] - G{y{T)) + 2e\ 



k=l 



Next w.l.o.g we assume that f < t. Then we deduce that: 

q^it',x')-q^it,x) < [ {{iJ{s,y'{s),T\s))-^P{s,y{s),r\s)))l[s>t]}ds 

T 



+ / i'is,y'{s),T'^{s))l[t'<s<t]ds 

J to 

n 



(3.9) ^ ,=1 

< / {ms,y'{s),T\s))-ij{s,y{s),T\s))\l[,^,]} 



to 



+ / \'ip{s,y'{s),T'^{s))\l[t><s<t]ds 
+nmkx\C{tk,y'{tk),Ck) - C(tk,y{tk),Ck)\ + 2e^ 



'to 
m 

k=l 

Using the uniform continuity of C in y and property (13. ip . then the right-hand side of 
(I3.9p . the first and the second term converges to as t' tends to t and x' tends to x. 
Taking the hmit as {t\x') — )■ {t,x) we obtain: 

hmsup g"(t',x') < g"(t,x) + 2e^ 

As is arbitrary then sending ^ 0, to obtain: 

hmsup q'^it' ,x') < q'^it.x). 

Therefore g" is upper semi-continuous. 

Step 2. Now we show that is lower semi-continuous. 

Fix an arbitrary €2 > 0. Let 1^2 = ((^n)n>i5 (?n)n>i) belongs to Da such that 

sup[ / ^'(s, y'{s),T{s))ds + V C(4, y'(4), 6)l[t,<T] + G{y{T))] 
ren Jt' 

inf sup[/ ilj{s,y\s),r{s))ds + y^C{tk,y\tk),ik)Mt,<T]G{y{T))] + e2 



< 



q^{t',x') + e2. 
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Also, 

i-T " 

g"(t, x) < sup[ / ^(s, y{s),T{s))\ys>t]ds + J] efc)l[i,<T] + G{y{T))l 

ren Jt 

now, pick T2 such that 



sup[ / ij{s,y{s),T{s))l[s>t]ds + y'C(tfc,?/(tfc),6)l[tfc<r] + G{y{T))] 



A;=l 

/•T " 

^ ^^-^'^ -^^ ■ 

k=l 



^lj{s,y{s),T2{s))lis>t]ds + ^C(4,?/(4),^fe)l[i,<T] + G{y{T)) + e2. 



Then 



q-{t', x') - q-{t, x) > f ij{s, y'{s)Ms))ds + V efc)l[t,<T] + G{y{T)) 

J^' k=i 

- [ ^{s,y{s),T2{s))ds -J2G{tk,y{tk),^knit,<T] - G{y{T)) 
Jt 



k=l 

-2e2. 



Next w.l.o.g we assume that t' < t. Then we deduce that: 

v{t',x') -v{t,x) > / {{'i{j{s,y'{s),T2{s)) - 'i{j{s,y{s),T2{s)))l[s>t]}ds 

+ / i^{s,y'{s),T2{s))lit,<,^t]ds 

J to 
n 

+ Y,{G{tk, y'{tk),^k) - G{h, y{h),^k)n[t,<T] - 2e2 



(3.10) 

rT 



{\'ilj{s,y'{s),T2{s)) - ij{s,y{s),T2{s))\l[s>t]}di 



> - 

- / \'^{.s,y\s),T2{s))\\^t'<s<t]ds 

Jto 

-n max \G{tk,y'{tk),^k) - C{tk,y{tk),^k)\ - 2e2. 
i<fc<?i 

Using the uniform continuity of ip, C in y and property (13. ip . Then the right-hand side 
of (13.91) the first and the second term converges to as t' — t and x' — )■ x. 
Taking the hmit as (t', x') — )■ (t, x) to obtain: 

hminf fl"(t',x') > o"(t,x) - 2e2. 
{t',x')^{t,x)^ V > ; - y V > ; 

As €2 is arbitrary then putting e2 — ?■ to obtain: 

hminf qk'x')>q"'(t,x). 

{t',x')^{t,x) 
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Therefore is lower semi-continuous. We then proved that g" is continuous. 
Step 3. Let us show that v is continuous, we have: 

(3.11) \v{t,x)-v{t',x')\ < \v{t,x)-q''{t,x)\ + \q''{t,x)-q''it',x')\ + \q''{t',x')-v{t',x')\ 

For n large enough, then we put n — > +00 and using lim q^{t,x) = v{t,x) and the 
continuity of q"'{t,x) in t and x, we get that the right hand side terms of f l3.1ip converge 
to as (t', x) — )■ (t, x). Therefore v{t', x') — > v{t, x) as {t' ,x') — j- {t, x). So v is continuous. 
□ 

3.3 Terminal value 

Because of the possible jumps at the terminal time T, it is easy to see that, in general, 
v{t,x) does not tend to G{x) as t tends to T. Extend the set of jumps to include jumps 
of zero, meaning no jump. Call this extended set Eq, extend trivially the operator to 
a function independent from t, and let 

(3.12) ^1(0;)= mi[G{x + g{T,x,0) + C{T,x,C)] = mm{G{x),N[G]{T,x)}. 

We know that G and G are uniformly continuous in x then Gi{x) is continuous. We claim 

Lemma 2 

v{t,x)^Gi{x) as t^T. 

Proof: Fix (t, x) and a strategy As in the previous proof, for each r(), gather all 
jumps of V2(t) if any, in jump ^1 at the time T. Then we have 

I J(t, X, yp, r) - G{x + g{T, x, ^i)) - C(T, x, 6) I < G^{T - t) 

or 

J(i, X, r) = G{x + g{T, x, 6)) + C(T, x, 6) + ^(r - t). 

The right hand side above only depends on (^1, not on t(.) itself. It follows that 

inf sup J(t, X, r) = inf [^(x + g{T, x, 0) + C(T, x, 0] + 0{T - t) 
= Gi{x) + 0{T~t). 

The result follows letting t — )■ T.D 
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4 Viscosity characterization of the value function 



In this section we prove that the value function w is a viscosity solution of the Hamilton- 
Jacobi-Isaacs quasi-variational inequahty, that we replace by an equivalent QVI easier to 
investigate. 

We now consider the following quasi-variational inequality (Isaacs equation): 



(4.1) 



max < mm 

reK 



dv dv 



v{t,x) - N[v]{t,x)} = 0, 

with the terminal condition: v{t,x) = G'i(x), x G M"^, where Gi is given by fl3.12p . 
Notice that it follows from hypothesis that the term in square brackets in (14. ip above is 
continuous with respect to r so that the minimum in r over the compact /C exists. 
Recall the notion of viscosity solution of QVI (14. ip . 

Definition 3 Let v be a continuous function defined on [0,T] x M^, JR-valued and such 
that v{T, x) = Gi{x) for any x G M"^. The v is called: 

(i) A viscosity supersolution of (JjJ^ if for any (t, x) G [to,T[xlR"^ and any function 
if G C^''^{\tQ^T[x]R™') such that f(t,x) = v(t,x) and {t,x) is a local maximum of 
(p — V, we have: 



(4.2) 



max i mm 

re/C 



-^-^f{lx,r)-mx,r) 
v{t,x) - N[v]{t,x)} > 0. 



{ii) A viscosity subsolution of ^.1^ if for any (i,x) G [to,r[xiR™' and any function 
ip G C^''^{[tQ,T[x]R'^) such that (p{t,x) = v(t,x) and (t,x) is a local minimum of 
(p — V, we have: 



(4.3) 



max s mm 

rS/C 



v{t,x) - N[v]{t,x)} <0. 



[Hi) A viscosity solution if it is both a viscosity supersolution and subsolution. □ 



Theorem 4 The value function v is the viscosity solution of the quasi-variational in- 
equality ( [/^.ip . 
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Proof: The viscosity property follows from the dynamic programming principle and is 
proved in jT3].D 



Now we give an equivalent of quasi- variational inequality ( I4.ip . In this section, we 
consider the new function T given by the classical change of variable T{t, x) = exp(t)v{t, x), 
for any t G [to)2^] and x G M"^. Of course, the function F is bounded from below and 
continuous with respect to its arguments. 
A second property is given by the 



Proposition 3 v is a viscosity solution of Ili4-1^ if and only if T is a viscosity solution to 
the following quasi-variational inequality in [tQ,T[x]R^ , 



(4.4) 



max < mm 



dV dV 

-— + r(t, x) - -Q^f{i. X, t) - exp{t)ij{t, X, t) 
T{t,x) - M[T]{t,x)} = 0, 



where M[r]{t,x) = mf[r{t,x + g{t,x,^)) + exp{t)C{t,x,^)]. The terminal condition for 
r is: T{T,x) = exp{T)Gi{x) m iR^.D 

5 Uniqueness of the solution of quasi-variational in- 
equality 

We are going now to address the question of uniqueness of the viscosity solution of quasi- 
variational inequality ( 14. ip . We have the following: 



Theorem 5 The solution in viscosity sense of quasi-variational inequality ( [-^.i[ ) is unique 
in the space of continuous functions on [to, T] x which satisfy a linear growth condition, 
i.e., in the space 

C := {ip : [0,T] X JR"^ — )■ M, continuous and for any 

{t,x), (p{t,x) < C(l + \x\) for some constants C and bounded from below}. 

Proof. The proof is divided in four steps. We will show by contradiction that if u and w 
is a subsolution and a supersolution respectively for f l4.4p then u < w. Therefore if we 
have two solutions of (14. 4p then they are obviously equal. 

Now we fix A G (0, 1), close to 0, and prove the comparison result for (1 — X)u and w. 
Actually for some R> suppose there exists {t,x) G (0,T) x (Br := {x G M^; \x\ < 
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R}) such that: 

(5.1) max((l — X)u{t, x) — w{t,x)) = {1 — \)u{t, x) — w{t, x) = rj > 0. 

t,x 

Step 1. Let us take /5 > and 9 e (0, 1] small enough, so that the following holds: 

f -/5(T-f)2-Aexp(T)Gi(x)<| 



Then, for a small e > 0, let us define: 
(5.3) 



$e(t, X, y) = {1- X)u{t, x) - w{t, y)-j-Jx- - 9{\x - x\^ + \y - xf) 
-(3{t-tr. 



By the linear growth assumption on u and w, there exists a {to, xq, yo) G [0, T] x Br x Br, 
for R large enough, such that: 

^e{to,xo,yo) = max^e{t,x,y). 
On the other hand, from 2^^{tQ, Xq, yo) > $e(to) Xq, Xq) + $e(to; 2/0) Ho), we have 

(5.4) ^|a;o - yo^ < (1 - A)(w(to,a;o) - u{t,x)) + {w{to,yo) - w{t,x)), 

and consequently ^|xo — yo^ is bounded, and as e — >■ 0, \xo — yo\ ^ 0. Since u and w are 
uniformly continuous on [0, T] x then ^|a:o — ?/oP — >■ as e — >■ 0. 
Since $e(io, 2;o, yo) > ^e(^, ^, ^), we have 

(5.5) (1 - X)u{t,x) - w{t,x) < ^^{to,xo,yo) < (1 - X)u{to,xo) +w{to,yo). 

it follow from the continuity of u and w that, up to a subsequence, 

{to,xo,yo) {t,x,x) 

(5.6) e{\xo-x\^ + \yo-x\^)~^0 

(1 - A)M(to, a;o) + w{to, yo) ^ (1 - X)u{t, x) - w{t, x) 

Step 2. We now show that to < T. Actually ii to — T then, 

^S,^,x) < ^,{T,xo,yo), 

and, 

{1 - X)u(t,x) - w{t,x) < {1 - X) exp(T)Gi(xo) - exp(T)G'i(yo) - PiT -tf , 
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since u{T,xo) = exp{T)Gi{xo), w(T,yo) = exp(T)Gi{yo) and Gi is uniformly continuous 
on Bji. Then as e — )■ and (15. 2p . we have, 

V < -/3(T-t)2- Aexp(T)Gi(x) 

V <i, 

which yields a contradiction and we have to G [0, T). 
Step 3. We now claim that: 

(5.7) w{to, yo) - mijwito, yo + g{to, yo, 0) + exp(to)C(to, Vo, 0] < 0- 



Indeed if 



w{to, yo) - inf [u7(to, yo + 9{to, Vo, 0) + exp(to)C(to, Vo, 0] > 0, 



then from Proposition 2 we have: 

-"^(^o, yo) - inf [u'lto, Vo + gito, Vo, 0) + exp(to)C(to, 2/o, 0] = 0, 
then there exist E E and small ei > such that: 

w(to,2/o) - w{to,yo + g{to,yo,^i)) - exp(to)C(to,?/o,6) > -ei- 
From the subsolution property of u{to,xo), we have 

u{to, xo) - inf [u(to, xo + g{to, xo, 0) + exp(to)C(to, xq, 0] < 0, 

then 

u{to, Xo) - u{to, Xo + gito, xo, 6)) - exp(to)C(to, a:o, Ci) < 0. 

It follows that: 

(1 - \)u{to, Xo) - w{to, yo) - [(1 - A)M(to, xo + g{to, xo, 6)) - «^(^o, Vo + g{to, Vo, ^i))] 
< (1 - A) exp(to)C(to, Xo, 6) - exp{to)G{to, yo, 6) + ei. 

Now taking into account of (15. 3p to obtain: 

^,{to,xo,yo) - ^,{to,xo + gito,xo,^i),yo + gito,yo,^i)) 
< -j-Jxo - yo? - 0{\xo - + \yo - x\') - m - W 

+ Ye\^0 + gito,Xo,il) - ?/0 - fi'(^0,?/0,6)P 

(5.8) +e{\xo + ^(to, Xo, 6) -x\'+\yo + g{to, yo, 6) - x\^) + P{to - t)^ 

+ (1 - A) exp(to)C(to, Xo, ii) - exp{to)G{to, yo, Ci) + ei 

<Te\xo- yo\^ + o\g{to, Xo, 6)1' + o\g{to, yo, 6)1' 

-Xexp{to)G{to,Xo,^i) + exp{to)C{to,Xo,^i) - exp(to)C(to, ?/o, 6) + ei- 
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Here in the last inequality we have used g is Lipschitz in x. Now since C and g are 
uniformly continuous on [0, T] x then 



-A exp{t)C{t, X, + 26 \ g{t, x, 6) |' +e(2 + 2^ + A) + ei. 



Since fl5.2p . sending e — )• and sending ei — )■ 0, we get 

^e{to,xo,yo) < ^eito.xo + g{to,xo,^i),yo + 5(^0,^0,6)) 

This is contradiction to the fact that {to,Xo,yo) is the supremum point of $£. Then the 
claim fl5.7D holds. 



Step 4. To complete the proof it remains to show contradiction. Let us denote 

(5.10) ip,{t,x,y) = — \x-y\'^ + e{\x-x\^ + \y - x\^) + (3{t -tf . 
Then we have: 

r Dtip,{t,x,y) = 2P{t-t), 

(5.11) <^ D^ip,{t,x,y) = ^{x-y) + Ae{x-x)\x-x\^, 

[ Dy!f,{t,x,y) = -i(x - y) +Ae{y -x)\y ~x\'^. 

Let c,dElR such that 

(5.12) c + d = 2(3{to-t). 



Taking now into account (15. 7p . (15.121) . and the definition of viscosity solution, we get: 

mm[-c+ (1 - X)u{to,xo) - {^{xq - yo) + AO^Xq - x)\xo - x]"^ , 
/(to, xo, r)) - (1 - A) exp(to)V^(to, xq, t)] < 

and 



(5.14) 
min 

T 

> 0. 



d + w{to,yo) - {^{xo-yo) - 4:9{yo - x)\yQ - x\'^ , f{to,yo,T)) - exp(to)^(to, 2/o, r) 
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which imphes that: 
(5.15) 

-c-d+{l- X)u{to, xo) - w{to, yo) 

<mm -(-(xo-yo) -4:e{yo-x)\yo-x\'^,f{to,yo,T)) - exp(to)V'(^o, l/o, t) 



— mm 



< 



sup 



sup 



e 

-(i(xo - yo) +4:9{xo-x)\xo-x\^,f{to,xo,T)) - (1 - X) exp{to)ip{to,xo,T) 
{\xo - yo) + Ae{xo -x)\xo - ^P, f(to,xo,T)) + (1 - X) exp{to)ip{to, xo,t) 
{^{xo - yo) -4:e{yo-x)\yo-x\^,f{to,yo,T)) + exp{to)'ilj{to,yo,'r) 



< sup[(-(xo - yo), f{to,Xo,T) - f{to,yo,T)) 

+ {Ad{xo-x)\xo-x\'^J{to,Xo,T)) + {Ae{yo-x)\yo-x\'^J{to,yo,r)) 
+ (1 - A)exp(to)V'(to,2;o,r) - exp()f:o)^(to, J/o, ^)]- 

Now, from (12.31) . we get: 

1 C 

{-{xo - yo),f{to,Xo,r) - fito,yo,T)) < —\xo - yol^. 



Next 



and finally, 



(46'(xo - x)\xo - xp, /(to, Xo, t)) < 4C6'|a;o| 1^0 - x\ 



{Ae{yo - x)\yo - x\\ /(to, yo, r)) < 4C^|l/o| I2/0 - x\\ 



Taking in to account 

c + d = 2/3{to-t). 
So that by plugging into (I5.16P and note that A > we obtain: 



-2^(to - t) + (1 - A)M(to, Xo) - w{to, yo) 
C. 



(5.16) 



< j|xo - yoP 

+4C^|xo| |xo - + ^Ce\yo\\yo - xf 

+ sup(l - A) exp(to)^(to,a;o,r) - exp(to)^(to, l/o, t)]- 



By sending e — )■ 0, 6* — )■ and taking into account of the continuity of tp, we obtain rj < 
which is a contradiction. Now sending A — )■ 0, we get the required comparison between u 
and w. The proof of Theorem [5] is now complete. □ 
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